Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

1 (currently amended). A method for determining the orientation 
of a captured digital image, comprising the steps of: 

a) employing a semantic object detection method to detect the 
presence and orientation of a semantic object in the digital image : 

b) employing a scene layout detection method to detect the 
orientation of a scene layout of the digital image : and 

c) employing an arbitration method to produce an estimate of the 
image orientation from by arbitrating between the orientation of the detected 
semantic object and the detected orientation of the scene layout. 

2 (original). The method claimed in claim 1, wherein the step of 
employing a semantic object detection method comprises employing a plurality of 
semantic object detectors to detect a plurality of semantic objects and their 
orientations. 

3 (original). The method claimed in claim 2, wherein the semantic 
objects are selected from the group of semantic objects comprising: a human face, 
a human figure, clear blue sky, lawn grass, a snow field, body of open water, tree, 
a sign, and written text. 

4 (currently amended). The method claimed in claim 1, wherein 
the scene layout detection method comprises the steps of: 

a) dividing the digital image into non-overlapping image blocks; 

b) computing at least one statistic for each image block; 

c) forming a feature vector by concatenating the statistics 
computed from the image blocks; and 

d) using a trained classifier trained with a plurality of scene 
prototype images to produce an estimate of the image orientation. 



5 (currently amended). The method claimed in claim 4, wherein 
the statistic is a color moment related to one or more of: color, texture, and 
straight lines in the dig ital image. 

6 (original). The method claimed in claim 1, wherein the scene 
layout detection method comprises the steps of: 

a) extracting straight lines from the digital image; 

b) computing a point of convergence (or vanishing point) from a 
subset of the extracted straight lines; and 

c) producing an estimate of the image orientation according to the 

vanishing point. 

7 (original). The method claimed in claim 1, wherein the 
arbitration method employs a Bayes Net. 

8 (original). The method claimed in claim 1, wherein the 
arbitration method employs a decision tree. 

9 (original). The method claimed in claim 1, further comprising 
the step of: rotating the digital image to re-orient the digital image in an upright 
direction. 

10 (currently amended). A computer program product comprising 
computer readable storage medium hav ing a computer program stored thereon for 
performing the method of claim 1 . 

1 1 (currently amended). A system for processing a digital color 

image, comprising: 

a) a semantic object detector to determine the presence and 
orientation of a semantic object in the digital color image; 

fe) a scene layout detector to determine the orientation of a scene 
layout of the digital color image, said scene lav out detector having a classifier 
trained with a plurality of scene prototyp e images; 
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e) an arbitrator responsive to the orientation of the semantic object 
and the orientation of the scene layout to produce an estimate of the image 
orientation; and 

{d) an image rotator to re-orient the digital image in the upright 

direction. 

12 (original). The system claimed in claim 11, wherein the step of 
employing a semantic object detection method comprises employing a plurality of 
semantic object detectors to detect a plurality of semantic objects and their 
orientations. 

13 (original). The system claimed in claim 12, wherein the 
semantic objects are selected from the group of semantic objects comprising: a 
human face, a human figure, clear blue sky, lawn grass, a snow field, body of 
open water, tree, a sign, and written text. 

14 (currently amended). The system claimed in claim 11, wherein 
the scene layout detector comprises: 

a) means for dividing the digital image into non-overlapping image 

block; 

b) means for computing at least one statistic for each image block; 

c) means for forming a feature vector by concatenating the 
statistics computed from the image blocks; and 

d) moans for using a trained classifier to produce an estimate of the 
imago orientation said classifier . 

15 (currently amended). The system claimed in claim 14, wherein 
the statistic is a color moment related to one or more of: color, texture, and 
straight lines in the digital image . 

16 (original). The system claimed in claim 11, wherein the scene 
layout detector, comprises: 

a) means for extracting straight lines from the digital image; 



b) means for computing a point of convergence (or vanishing 
point) from a subset of the extracted straight lines; and 

c) means for producing an estimate of the image orientation 
according to the vanishing point. 

17 (original). The system claimed in claim 1 1 , wherein the 
arbitrator includes a Bayes Net. 

18 (original). The system claimed in claim 11, wherein the 
arbitrator includes a decision tree. 

19 (new). The method of claim 1 wherein said captured digital 
image is of a natural scene. 

20 (new). The method of claim 19 wherein the orientation of the 
detected semantic object and the detected orientation of the scene layout are 
contradictory. 

21 (new). The system of claim 2, wherein: 

each of said semantic object detectors detects the respective said 
semantic object orientation to be any one of: upright orientation, upside-down 
orientation, left-to-right orientation, right-to-left orientation, and undecided 
orientation and 

said scene layout detection method determines the orientation of 
the scene layout to be any one of: upright orientation, upside-down orientation, 
left-to-right orientation, and right-to-left orientation. 

22 (new). A system for processing a digital image comprising: 
one or more semantic object detectors, each said semantic object 

detector being adapted to determine the presence and orientation in the digital 
image of a semantic object of a respective one of a plurality of different types; 

a scene layout detector adapted to determine the orientation of a 
scene layout of the digital image; and 
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an arbitrator adapted to arbitrate between said determined semantic 
object and scene layout orientations and produce an estimate of an orientation of 
the digital image. 



23 (new). The system of claim 22, wherein each of said semantic 
object detectors determines the respective said semantic object orientation to be 
any one of: upright orientation, upside-down orientation, left-to-right orientation, 
right- to-left orientation, and undecided orientation. 

24 (new). The method of claim 23 wherein said orientations 
determined by two or more of said detectors are contradictory. 

25 (new). The method of claim 22 wherein said scene layout 
detector has a classifier trained with a plurality of scene prototype images. 

26 (new). The method of claim 25, wherein said classifier is one 
of a support vector machine and a neural network. 
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